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ABSTRACT 


The  method  of  quasi lineari zation  is  a  combination  of  the  properties 
of  the  high-speed  digital  computer  with  established  linearization 
techniques  in  such  a  fashion  that  it  can  be  used  as  a  method  of 
identifying  parameters.  The  mr  .hematics  used  in  the  program  is 
developed  in  detail  and  an  example  is  given  of  its  use. 

Essentially  the  method  is  an  efficient  device  of  searching  for 
unknown  parameters  existing  in  a  set  of  algebraic  or  differential 
equations.  The  mathematical  concepts  are  historical  but  the  com¬ 
bination  of  historical  mathematics  with  the  high-speed  digital 
computer  yields  new  and  useful  results. 
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1.  Q'NtRAI.  MSfRlPTION 


In  mnnv  computer  application?  there  i?  a  set  of  test  data  Y . . 
(value  of  some  qiven  function  r  at  a  rime  sample  1  from  ,n  experiment 
and  a  mathematical  model  of  the  experiment  that  take?  the  form. 


(1.1) 


(ij  ( x  ( 1 1 1 


J  --  1 


where  >.  (tl  is  constrained  hy  N  fi  r?t  order  differential 


(1.21 


x  f  1 1  =  f  f  x  ( t )  ,  t :  cl 


\K 

count i  ons 


with  initial  condition?  x(tQl.  The  vector?  xit),  f(x(t),t:c)  and  c  are 


(1.3! 

fl  .41 

M  .SI 


xrtl  =  (x1 (tl , x  2  f  t  T , . . . ,xn(t)) 


ffxftl ,t ;c)  =  (fj (x(t) ,t ;c) ,f2(x(t) ,t ;cl . f^fxftl ,t ;c) 1 


r  *  ,ci  •  c2 . ci  -  ci,.r  . <W-  1  4  v 


The  first  I  components  of  the  vector  c  represent?  a  set  of  I 
unknown  initial  conditions  and  the  l.*1  to  l.+  k  component?  of  c  are  unknown 
parameters  of  a  piven  set  of  differential  equations,  hetermininq  the 
vector  c  from  test  data  would  provide  a  complete  mathematical  mode  1  of 
the  experiment. 

One  method  to  determine  c  would  he  to  select  it  in  seme  sort  of 

intuitive  way,  substitute  it  into  (1  "’)  ,  integrate  11.21,  -■  ..stitute  this 

value  of  x(t)  into  (1.11  and  then  compart  with  the  knowp  test  data  Y  .. 

1 1 

From  the  results  an  intuitive  "ipse  could  he  made  for  another  c  that 

mi  "ht  brine  q .  (x(t .))  closer  to  the  test  d-'ta  Y.  .  A  search  of  tin  '-no 
J  1  li 

i?  time  consuming  and  requires  cuessinr,  as  one  approaches  the  concent  of 
a  "rood  fit." 

Richard  Heilman  fl|  ha?  described  a  method  that  uses  the  computer 
to  search  for  a  vector  c  that  mini  mixes  the  equation, 

NP  NK 

H.M  Mcl  r  \  \  .  (r.  (x(t.  n  -  Y  l2 

L _ »  i _ »  1  >  i  j  i 

i  3 1  i  *  1 
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where  vCtl  , «  determined  from  x  t)  =  ffxftl.t  r)  with  initi.il  rnndi  t»  «'nr 
y(t  1  infi  ^  i  ire  rr*  1  it i ve  weight'-  of  \'K  different  ^'inotion*:  **  '*( 

<1  i 

Thi?  rf'-'-irt  hoc  ti.c  theor'-  'r»,i  >  n  the  m  'oni'eteT-  pj-o 

tl'it  qnrc,’f'<'  for  the  mi  ni nun  of  c'rnt  i  or.  M  <« '  .  Th0  •>r->.  r  ■  •  ■«  ori  -v  n 

oht  lined  it  llf  '  .tnd  then  modified  extent  i  ve  1  v  bv  I'r.  dohn  T  fieri;  to 
imrr'"-0  the  conve^-’enco  technique's  for  :i  oivon  •'olution. 


J 

] 
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MATHEMATICAL  ANALYSIS 


2.1  Approximations  and  Assumptions 


In  equation  (1.S)  the  components  of  vector  c  are  assumed  to 
he  composed  of  !  unknown  initial  conditions  and  k  unknown  parameters. 

Although  the  equation  r>.fx(t))  in  many  cases  will  he  simply 

c.fxftl)  =  x.(t),  for  the  purpose  of  hein"  neneral  e.fxft))  is  considered 
1  1  '  .1 

as  any  function  of  x(t)  that  may  he  approximated  hv, 

"i  npxtip 

CM, 

k  =  l 


where  x(t)  is  the  vector  ccnerated  hv  assuminr  (or  calculatin'1)  an  initial 
o 

vector  c,  (1.51,  and  integrating  ('.2)  over  the  desired  ranee  of  the 

independent  variable  t.  It  is  about  this  nominal  vector  x ■ t )  that  the 

(1)  0 

1 i neari rat i on  (2.1.1)  takes  place 


S(c) 


Suhsfi tut  ini’  (2.1.1)  into  (1.6)  pivos. 


k  =  l 


^  rj(xift)0) 

■*'  xk 


(2.1.2) 


where 

x^(t)  =  the  nominal  op  present  k-th  component  of  the  vector  xft). 
x^(r)  -  the  improved  k-th  component  of  vector  x(t). 


Let 


(-M..V1  :>k  "  ’  \(t»„  *  'id'1 


where 


e.k(t)  - 


correction  on  the  vector  component  x^ft). 


(1) 

x(t)  is  the  nominal  or  present  value  of  vector  xft) 

x(t . )  is  the  value  of  the  vector  x(t)  at  t  *  t 

1  1 
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Assume  that  f  ft)  may  he  approximated  by  the  linear  expression. 


(2.1.4)  €k(t)  = 


X.h.  ft)  ♦ 

i  k  i 


V" 


k  =  1  .  \f 


where 


&  -  corrections  to  unknown  initial  conditions 

i 

y  =  corrections  to  the  unknown  parameters 


i  *  t  ,  i  v  r  t  >  -  v  '  *■  '  +i  i  <  i  s 

o  imuatcu  l  o  o  present  micss  j 


(2.  l.M 


c  -  c  ♦  Y 

i  undated  io  present  yuoss 


■1  S  i  S  !>k 


and  the  functions  h .  .(f)  ami  r,  ,(t)  are  solutions  to  the  linear 

(1)  ’ 

di ff erent i  1 1  euuat l oris 


(2.1.7)  h,  .  (t )  =  /  ,  -  ■  -  h  .  (t), 

k  i  4 - x  n  i  ’ 

n  - !  °  n 


i  =•  1  l 


where  h  .ft  )  =  J  n 
n  i  o 


jf )  14) 

=  J  l> 


(■  l.S)  r, 


t  ^  fk  J  s  1  •  * 

•  •  -  r  . (r >  ♦ 

“2>  *n  ni  k  =  ’*  S 


where  r  ( t  )  =  t> 
nio 


It  is  assumed  that  x(t)  can  he  linearized  so  that  to  a  first 
approximation  the  corrections  £  ft)  depend  line.arlv  on  £  and 


( 1 '  Where  these  >1  i fferent i a  1  conations  and  their  initial  conditions  comc 
from  will  he  shown  in  Section  2.2. 


(  2 )  e  =  v  .  ( t  ) 
1  i  o 


c  .  =  x  ( t  ) 

10  1  o  o 


fa)  f^  j  f^(x(tl.t;c)  here  and  in  the  sequel. 


n  =  l  for  n  =  i 
=  0  otherwise 


and  when  convergence  is  obtained 


(2.1.9)  £  .  - *•  0,  y. - *  0,  and  6.  ft  )  - -  n 

i  j  k 

2.2  1 i near i cat i on  of  tiic  hi  f  fcrent  i  a  I  I  mentions 

l.i neari  rat  i on  of  the  di  f  ferent  i  a  ]  system  (1.2)  violas  equations 
(2  1.71  and  (2.1. HI.  To  show  how  these  differential  eunations  are  derived, 
rewrite  for  convenieiu'e  omiation  (1.71, 

12.2.  1  ’  x(ti  -  ffx't!  ,fcl 

where  tlie  initial  conditions, 

(2.7.21  x .  (t  ,  -ftr  x  .  =  c.  are  11  i  von  initial  condition  messes 

t  o  10  i 

.-1,1 

and 

(7.7  o'1  c  e  are  riven  "nmneter  <’nes«es 

i  1  o  1 

i  =  I  *  1  .  I  +  k 

knovn  initial  conditions,  if  arv ,  are, 

(2.7'  \  l t  )  =  x  .  •  =  !  *  1  \ 

1  n  }  n  • 


IN  in*'  the  ini  rinl  e<>ruli  t  ■»  ?  ?  '■  r1  ■.>  c  I  "'irr-'f-'r 


r\  \  V 

and 

flap  V  np'x  -M 

’  n>  t  ■  '1  eond  i  t  i  on s  \  7  .  ’  .  1  1 

ra-”,.,.  !’  VP 

*  r*.-'  r*  f  r  T 

o 

t  t  I 

r  rr 

i  n  l  1  !  i  ' 

•<nd  s  tore  the  •-  o  1  -  t  ’  or  i» 

i  c-eal!\  st>a;ed 

trr 

t  -  t  , 

i  *(' 

*  i  -n  if«'  f  hi 

<  » ;T  i  •>*■*  j  v  x  ’■  f  ^ 

l  n 


I  ’it  ’  •»**!:it  i  n:r  r  \  >  t  )  ;m<i  v* 
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Substitution  of  equations  (2.1.3)  and  (2.1.0)  into  (2.2.3)  rives 


.2.2.0)  x,  ft)  +  d.ftl^f,  f Y r t )  )  +  / 

k  o  k  k  o - -1  — \ 

n=  1  * 


C-  (t)  *  /  _ 

x  n  i- — — *  1)  c 

n  n^i  °  l>n 


b  V 


Substitutin'’  (2.1.4)  info  (2.2.6)  and  collecting  terms  of  ^ 


ind  / 


r l ves , 


(2.2.7)/  £  I 

i^  1 L 

K  r 


.  d  .  h,  .  ft)  -  /  „  _  h  . ft) 

— r*  i  k  i  - r1  ^  x  n  i 

1  =  1  n=  1  u  n 


s  3  r  (U  -  ^3 

-  x  nj  -S’  r 

<•  ’  n  ^  I  *  i 


Inuatinp  the  coefficients  of  <f  and  V  equal  to  zero  fives  the  differential 

_i  i 

equations  (2.1.7)  and  iJ.l.S). 


F:or  convenience  of  no*  u  um  /.  V  ,  h,  (t)  and  r  (t) 

i  !  k  l  k  i 


will  K ”  redefired  as 

1  2 .  2  .  8 ) 

d  = 

1 

1 

i  =  i.i 

(2.2. 9 ) 

d  . 

i 

*  L  = 

i 

i 

i  ■  1  .  k 

(2.2.  101 

V 

((t)  - 

h.  f T ) 
k  i 

,1*1.1.  k  =  1 

,  s 

(2.2.11) 

"k 

(t)  * 

I 

r.  ( 1 1 

k  i 

i  *  !  ♦  1  .  k  k  *  i 

; .  s 

( ((nations 

(2.2 

S)  -  1 

2.2.1!'  may  now  be  used 

to  define  conation  (2.1 

.  4  1 

U  =  l.*k 

-  —  ... -  y 

(2.2.  12) 

< 

V?1 

=  /  d  H  (t) 

/  1  K  1 

k  *  1 

.  N 

and  the  differential  set  of  equations  (2.1.7)  ,inc;  ,2.1.S)  becomes, 

N 


(2. :. 13) 


\  »  >  k  w 

TT  7X„ 


i  =  l.l. 


(2.2.14) 


W.  . 
Ki 


~c>h  ^  fk 

W  .  *  . 

l>Xn  "3  >  Cj 


1.  ♦  1 ,  K,  k  =  1  .  N 


To  establish  the  initial  conditions  for  equations  12.2.13)  and  12.2.14) 
note  that  at  t  -  t  ,  equation  (2.1.3)  is( 


cind  equation  (2.1.5)  is. 


(2.2.16)  x.  (t  )  =  x.  (i 

NO  K 

"  V  * 

o  0 

k  =  1  ,  1. 

which  imp  lies  that  at 

c 

4- 

II 

4- 

.  k . 

Si  nee  C  ,  ( t 
k  n 

\  -  . 

at  t  =  t 

0 

.  the  initial  conditions 

set  of  linearised  differential 

equat i ons 

(2.1.7)  and  (2.1  .8)  n^: 

(2.2.17)  IV,  .(t  ) 

k  i  o 

<  J 
=  d  k 

i  =  1,  L 

k  r  1,  N 

(2.2.18)  W  (t  ) 

k  1  0 

=  0 

j  =  1.  + 

1.  K  k  =  1,  N 

2.3  Solving  For  (Corrections  to  Unknown  Initial  Conditions 
and  Unknown  Parameters . 

llsinq  equations  (2.1.5)  and  (2.2.12),  equation  (2.1.2)  may  he 
exnressed  as , 
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Setti ng , 


j 


(2.3.3)  o.  ft 


■>  P  fx(t  )) 

tW  W .  fts)  -  -A- -- 


1  4-_»  Vni  ’  ^  ~k 


k  =  l 


(2 . 3 .  2)  becomes  , 


r 2 . 3 . 4 1  sr.n 


NP  NK  r  ' y 

■  E  D’E 

i  =  1  <  =  1  L  m=l 


(I  " .  (t.)-Y..-r.(x(t.)  ) 
m  im  i  n  1  i  <v 


The  set  of  (1  1 5  that  make  f  2 .  3.41  a  minimum  are  determined  hv 
m 

taking  the  martial  of  sfei  with  respect  to  J  and  setting  these  partials 

to  " e ro  ,  Tin i r 


NP 


Sfci) 


i  -1 


'  Nk  I  k 

EEC 

i=l  m=l 


d  o.  (t.)-fY. -o.fxft.l  1) 

m  im  :  ill  1  o 


c.v  rt.  i  =  o 

>k  i 


i'2.  3  .  Si 


k  =  1  .  Ik 


or. 


NP  NK 


L  -i  LL^ 

* tn  ■  -  *-  1  - 

m=1 

IK 

.  E 


i  =  l  i  =  I 


■.  ft.  1m,  ft.) 
1  m  1  a  K  ! 


m=  1 


I.  <!  r  |) 
km  m  k 


NP  NK 


i  =  1  i  =  1 


k  =  1,  IK 


i  f  Y  .  .  •’  .  f  X  f  t .  )o1  n  f  t .  ) 
n  i  i  |k  l  ' 


f2.3.f>) 


where 


f 2  .  3 . 7)  I 


NP  NK 


km 


■  E  C\ 


1=1  i=i 
NP  Nk 


r.  (r . ) p  . .  ft . ) 
lm  i  ik  t 


’k  r  ^i[VV*fVol>fV 


k  =  1  .  IK 


bo) vine  the  linear  set  of  algebraic  equations  f?.3.<'1  in  the 
K  unknowns  d^  "ives  the  rorreetions  to  the  initial  renditions  and  parameters 
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3.  ^IA5’^ 

In  Figure  I  a  very  general  computer  flow  diagram  is  represented. 
The  purpose  of  this  diagram  is  not  to  explain  all  the  details  of  the  pro¬ 
gram  but  fo  give  a  general  idea  how  the  equations  developed  in  Section  2 
are  programmed.  A  brief  description  of  the  seven  blocks  shown  in  Figure  1 
is  as  follows: 

1.  Read  Input  Data  requires  that  the  user  furnish  an  initial 
guess  for  the  vector  c  or  a  subroutine  that  produces  a  set 
of  initial  guesses  from  the  data  (equation  (1,5)).  This 
amounts  to  furnishing  I,  initial  guesses  to  the  unknown 
initial  conditions  and  K  initial  guesses  to  the  unknown 
parameters.  Known  initial  conditions,  system  constants,  and 
test  data  must  also  he  furnished. 

2.  Solving  equation  (1.2)  for  a  complete  solution  over  the 
interval  (t^.T)  is  performed  by  a  numerical  integration 
scheme  that  is  part  of  our  present  CAI.  computer  facility. 

The  results  of  tips  integration  are  stored  temporary  ly  in 
core.  Symbolically,  this  solution  is  called  x(t)o  (It  is 

important  to  note  tl  .  x(t)  4  x(t  )). 

O’  o 

7  Solve  linearized  equations  and  accumulate  elements  of 
matrices  I-  and  D. 

4.  Solves  a  set  of  L  +  K  linear  equations  given  by  (2.3.6)  for 
the  L  ♦  K  unknowns  d.  .  The  d^ ,  i  *  1,  L  ♦  K  are  corrections 
to  the  1,  unknown  initial  conditions  and  the  K  unknown 
parameters . 

5.  Correct  the  initial  guess  for  vector  c  by, 

c.  *  c.  ♦  d.  i*l,L 

ill 

for  initial  conditions 

and . 

Cj  -  c.  ♦  d.  i  *  1-  ♦  1.  !■  ♦  K  , 

for  the  parameters. 
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6.  A  sufficient  condition  for  convergence  of  the  vector  c 

is  |Act|/|  £  (-.  for  i  =  1,  l  *  K.  £  is  a  parameter 

chosen  hv  the  user.  Special  convergence  tests  and  modifi¬ 
cations  of  the  d.  are  included  to  ore vent  large  corrections 
1 

from  disturbing  the  solution. 

7.  Output  is  generated  in  a  subroutine  in  the  form  of  tables 
and/or  graphs. 

The  success  of  the  program  was  due  largely  to  the  inclusion  of 
techniques  for  handling  subsets  of  the  given  data  which  were  expanded  to 
include  the  complete  data  as  the  progress  converged. 


So  1  ve  Equat  i  on  (l .  2  ) 

for  x(t)  ,  t  ^  t  *  T 
o  o 


* 


Solve  Linearized  Set 
of  Equations  (2.1.7j  «jid 


(2.1.8) 


ZZHZ 

Solve  for  dm's  via 
Equations  (2.3.6) 

. . I . 

5 

Update  Unknown 
Initial  Conditions  and 
Parameters  via  Equations 
(2.3.8)  and  (2.3.9) 


* 


Test  for  Convergence 
of  dm's 

ZZ— t  _ _ 


Output 


Computer  Flow 
Diagram 

Figure  1 


4.  IDENTIFICATION  OF  PARAMETERS  EXAMPLE  | 

- - — — - - - - - - -  I 

i 

The  following  problem  of  Aircraft  Parameter  Identification  is  , 

used  here  to  illustrate  the  use  of  nsults  developed  in  Section  2.  For 
this  problem  equation  (1.1)  is, 


gj (x(t) )  S  Xj(t) 

g2(x(t))  s  x2(t) 

(4.1)  g3(x(t))  =  x3(t) 

g4(x(t))  =  x4(t) 


Where  x^t),  x2(t),  Xj(t)  and  x^(t)  are  constrained  by  the  set 
of  differential  equations, 


(4.2) 


(1) 


X1 

■ 

0 

1 

▲ 

0 

0 

X1 

~  0 

X2 

0 

C1 

C2 

C3 

X2 

C4 

X3 

3 

.054  7 

C5 

C6 

-1 

X 

X3 

♦ 

C7 

X4 

- 

0 

C8 

C9 

C10 

- 

X4 

C11 

For  this  problem  it  is  assumed  that  all  initial  conditions  are 
known  ar.d  are: 


(4.3)  x.(tQ)  -  0,  1*1,4 

Thus,  there  are  no  unknown  initial  conditions  so  that  L  =»  0  in  the  identity 
(1.5).  In  (4.2)  there  are  11  unknown  parameters  (c^,  i  ■  1,  11)  so  that 
K  >  11  in  identity  (1.5).  The  proolem  then  is  to  find  a  vector  c  »  ( .^  ,c^ , .  .c^) 
that  minimizes  (1.6).  The  program  does  this  provided  an  initial  guess  is 
assumed  or  calculated.  For  this  problem,  the  initial  guess  for  the  vector 
c  was  calculated  by  using  ipine  functions  {2J. 

4.1  Estimating  Initial  Vector  c  By  Spline  Functions 

Test  data  (designated  by  (j  ■  1,  4;  i  ■  1,  95)  was  given  for 

(1)  x  ^  ■  x^(t),  i  •  1,  4  here  and  in  the  sequel. 
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XjCt^,  x2(ti),  Xj(t^)  and  x4^i^  at  95  equally  spaced  points.  Using 
this  data  spline  functions  were  calculated.  Substituting  these  splined 
functions (designated  by  x^(t),  x2(t),  x^(t)  and  x^(t))  into  equations 
(4.2)  and  integrati"®  gives  the  set  of  estimates. 


1 


- 

r  r  t. 

vv 

0  10  0 

J  %  dt 
y0  1 

0 

A/ 

f  t. 

X2(V 

0  C,  c2  c3 

Jo  Xx2  dt 

C4 

m 

4 

w 

.0S467  c.  c,  -1 

D  O 

J  dt 

3 

C7 

vv 

0  C8  C9  C10 

s0\ « 

C11 

(4.4) 


i  =  1 ,  95 


Forming  a  measure  of  the  differences  between  Y  ^  and  x.(t^)  squared  as 

4 


(4.5) 

gives  for 


*  -E  B  ^  v 


j*l  i«l 


(4.6)  “  0  k  *  1,  11 
^  k 

a  set  of  eleven  linear  equations  in  the  unknown  c^,  k  ■  1,  11.  This 
method  proved  to  be  an  effective  way  to  get  an  initial  estimate  for 
vector  c. 


4.2  Lquations  Users  Need  To  Furnish 

The  user  needs  to  provide  the  mathematical  model  of  the 
experiment  such  as  is  given  by  equations  (1.1)  and  their  partials  with 
respect  to  x^.  Further  partials  of  equations  (1.4)  with  respect  to 
and  c^  are  needed.  Input  data,  system  constants,  and  convergence  test 
constants  are  also  needed. 

4.3  Results 

Figures  1  through  4  are  the  results  of  integrating  equations  (1.2) 


-14- 


(after  convergence  of  the  vector  c) .  The  symbol  x  in  the  figures 
indicates  the  data  points  for  j  ■  1,  4  and  i  *  1,  95  and  the 

continuous  curves  represent  the  final  solutions  of  equations  (1.2). 

The  vector  components  of  c  given  on  Figure  1  is  the  set  of  parameters 
that  this  quasi linearization  program  converged  to  and  this  vector  c 
represents  a  local  minimum  of  the  function  S(c)  given  by  equation  (1.6). 

Some  interesting  things  to  note  are  that: 

1.  Equation  (1.2)  can  be  non-linear. 

2.  Initial  guesses  for  c^'s  are  not  needed  if  equations  (1)  are 
linear  in  c^'s  (linear  or  non-linear  in  x) .  Phis  was  the 
case  d&scribed  in  4.1. 

3.  If  equation  (1.2)  is  non-linear  in  c^'s.  a  set  of  initial 
guesses  of  the  c^'s  is  required.  (In  many  cases  slight 
changes  in  the  math  model  will  permit  one  to  estimate  c^’s). 

4.  The  program  finds  a  local  minimum  of  (1.6).  Searching  techniques 
would  have  to  be  derived  to  find  a  global  minimum. 

It  is  the  opinion  of  the  authors  that  many  estimation  problems 
can  be  solved  by  this  method  of  quasilinearization.  Simplicity  of 
application  and  spe«.d  (about  12  minutes  to  solve  the  above  example)  appears 
to  be  some  of  its  values.  Combining  the  use  of  the  high  speed  computer  and 
historical  mathematics  gives  onethe  tools  to  solve  a  host  of  identification 
problems  that  in  the  past  would  have  demanded  many  hours  of  a  human  guided 
search  technique  to  converge  on  a  local  minimum  solution. 
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95  PTS.  RMS  =  .6  ( DEG) 


96  PTS.  RMS.  -  .129  (DEG/'tC) 


•  Zi 


(33S/830)  *  •  UX 


CONVERGED  ESTIMATE  OF  STATE 
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